CLIPVG: Text-Guided Image Manipulation Using Differentiable Vector Graphics
نویسندگان
چکیده
Considerable progress has recently been made in leveraging CLIP (Contrastive Language-Image Pre-Training) models for text-guided image manipulation. However, all existing works rely on additional generative to ensure the quality of results, because alone cannot provide enough guidance information fine-scale pixel-level changes. In this paper, we introduce CLIPVG, a manipulation framework using differentiable vector graphics, which is also first CLIP-based general that does not require any models. We demonstrate CLIPVG can only achieve state-of-art performance both semantic correctness and synthesis quality, but flexible support various applications far beyond capability methods.
منابع مشابه
Retrieving Vector Graphics Using Sketches
In this paper we present an approach to allow indexing and retrieving vector graphics by content, using topological and geometric information automatically extracted from figures. The method described retrieves WMF ClipArt files as an instance of the general problem of searching vector drawings. Our prototype can already handle databases with thousands of drawings using commodity hardware. Our ...
متن کاملText-Guided Attention Model for Image Captioning
Visual attention plays an important role to understand images and demonstrates its effectiveness in generating natural language descriptions of images. On the other hand, recent studies show that language associated with an image can steer visual attention in the scene during our cognitive process. Inspired by this, we introduce a text-guided attention model for image captioning, which learns t...
متن کاملEvolving Pop Art Using Scalable Vector Graphics
In this paper we present our findings of our continued investigation into the use of Scalable Vector Graphics as a genotype representation in evolutionary art. In previous work we investigated the feasibility of SVG as a genetic representation for evolutionary art, and found that the representation was very flexible, but that the potential visual output was somewhat limited by the simplicity of...
متن کاملUsing scalable vector graphics to evolve art
In this paper we describe our investigations of the use of Scalable Vector Graphics as a genotype representation in evolutionary art. We describe the technical aspects of using SVG in evolutionary art, and explain the genetic operators mutation and crossover. Furthermore, we compare the use of SVG with existing representations in evolutionary art. We perform two series of experiments and descri...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence
سال: 2023
ISSN: ['2159-5399', '2374-3468']
DOI: https://doi.org/10.1609/aaai.v37i2.25326